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We describe searches for decays of B mesons to the charmless final states rj'rj'K. The data 
consist of 228 million BB pairs produced in e + e~ annihilation, collected with the BABAR detector 
at the Stanford Linear Accelerator Center. The 90% confidence level upper limits for the branching 
fractions are B(B° -> n'n'K ) < 31 x 10~ 6 and B{B+ -> r)'r)'K + ) < 25 x 10~ 6 . 

PACS numbers: 13.25.Hw, 12.15.Hh, 11.30.Er 



The phenomenon of CP violation has been extensively 
studied in recent years at the B factories. The obser- 
vations of mixing-induced CP violation in B° — > J/ifjKg 
decays Q and of direct CP violation both in the neu- 
tral kaon system and in B° — > K + ir~ decays are 
in agreement with expectations in the Standard Model 
(SM) of electroweak interactions Some possible 

evidence of disagreement between experimental results 
and SM expectations is found in B decay modes domi- 
nated by penguin amplitudes, for example in the decay 
B° — > rj'K® [5j . Further important information about CP 
violation and hadronic B decays can be provided by the 
measurements of branching fractions and time-dependent 
CP asymmetries in B decays to three-body final states 
containing two identical neutral particles of spin zero and 
another spin zero neutral particle Q . An example of such 
a decay is B° — » KgKgKg, which has already been ob- 
served 0- Since the branching fractions for the decays 
B —>■ rj'K are large [{|, another example which might be 
particularly interesting for time-dependent CP violation 
analysis is the mode B° — ► rfrfK . 

We present the results of searches for the exclusive de- 
cay modes B + — ► r]'r]'K + [j| and B° — ► rj'r/'K , which 
are studied for the first time. The results are based on 
data collected with the BABAR detector at the PEP- 
II asymmetric-energy e + e~ collider 01 located at the 
Stanford Linear Accelerator Center. The analyses use 
an integrated luminosity of 207 fb~ , corresponding to 
228 million BB pairs, recorded at the T(AS) resonance 
(center-of-mass energy y/s = 10.58 GeV). 

Charged particles from the e + e~ interactions are de- 
tected, and their momenta measured, by a combination 
of five layers of double-sided silicon microstrip detectors 
and a 40-layer drift chamber, both operating in the 1.5 - 
T magnetic field of a superconducting solenoid. Photons 
and electrons are identified with a CsI(Tl) crystal elec- 
tromagnetic calorimeter (EMC). Further charged parti- 
cle identification (PID) is provided by the average energy 
loss (dE/dx) in the tracking devices and by an internally 
reflecting, ring-imaging Cherenkov detector (DIRC) cov- 
ering the central region. A K/ix separation of better than 
four standard deviations (a) is achieved for momenta be- 
low 3 GeV/c, decreasing to 2.5 a at the highest momenta 
in the B decay final states. 

The B daughter candidates are reconstructed through 
their decays 77' — > ?77r + 7r~ {-q 1 ), where rj — > 77, and 



i]' — » p 7 (rj' pl ), where p° — > 7r + 7r~. We require the labo- 
ratory energy of the photons to be greater than 30 MeV 
for 77' ^and 200 MeV for r]' pi . We impose the follow- 
ing requirements on the invariant mass (in MeV/c 2 ) of 
the candidate final states: 490 < 771(77) < 600 for 77, 
930 < m(7r+7r-77) < 990 for 77^, 930 < 777(71+77^7) < 
990 for 77^, and 510 < m(7r+7T-) < 1000 for p°. Sec- 
ondary tracks in 77' candidates are rejected if their PID 
signatures from the DIRC and dE/dx are consistent with 
those for protons, kaons, or electrons. Charged K candi- 
dates are selected if their PID signatures from the DIRC 
and dE/dx are consistent with that for kaons. Candidate 
Kg decays are formed from pairs of oppositely charged 
tracks with 486 < m(7r + 7r _ ) < 510 MeV/c 2 , a decay ver- 
tex x 2 probability larger than 0.001, and a reconstructed 
decay length greater than three times its uncertainty. 

We reconstruct the B meson candidate by combining 
two 77' candidates and a charged or neutral kaon. We 
consider only cases with two 77' ^ candidates or a rf^^ 
and a 77' . We do not consider the case with two 77' 
candidates due to the high background present in this 
mode. From the kinematics of the T(4S) decays we de- 
termine the energy-substituted mass 777es = \j \ s ~ P% 
and the energy difference AE = Eb — where 
(Eb,Pb) is the B meson 4-momentum vector, and all 
values are expressed in the T(AS) frame. The resolution 
is 3.0 MeV/c 2 for m E s and 26 MeV for AE. We require 
5.25 GeV/c 2 < m ES < 5.29 GeV/c 2 and \AE\ < 0.2 GeV. 

Backgrounds arise primarily from random combina- 
tions of particles in continuum e + e~ — > qq events (q = 
u,d,s,c). We reduce these with requirements on the an- 
gle 9t between the thrust axis of the B candidate in the 
T(4S) frame and that of the rest of the charged tracks 
and neutral calorimeter clusters in the event. The distri- 
bution is sharply peaked near | cos 0t\ — 1 for jet pairs, 
and nearly uniform for B meson decays. The require- 
ment is |cos#t| < 0.9 (Icos^tI < 0.7 for the charged 
mode with 77' ). We define the decay angle 0^ ec for the p 
meson as the angle between the momenta of a daughter 
particle and the 77', measured in the p meson rest frame. 
We require for the 77' decay | cos0^ cc \ < 0.9. Events are 
retained only if they contain one or more charged tracks 
that are not used in the candidate decay. 

We obtain the signal event yields from unbinned ex- 
tended maximum likelihood fits. The input observables 
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TABLE I: Fitted signal yield, fit bias, detection efficiency e (%), daughter branching fraction product significance S 

(a) , measured branching fraction B with statistical error for each decay mode. For the combined measurements we give the 
significance (with systematic uncertainties included) and the branching fraction with statistical and systematic uncertainty (in 
parentheses the 90% CL upper limit). 



Mode 


Yield 


Fit bias (ev) 


e(%) 


YIBi (%) 


S (a) 


23(10- 6 ) 


ri ri K° 
ri ri K° 


4.il 8 6 ; 7 


+0.5 
+3.8 


2.9 
3.7 


1.1 

3.6 


0.5 
0.0 
0.5 


c+20 
°-10 
i +27 
L -22 

5^ 4 ±1 «31) 


^Ifj 7T 7T ^7?7 7T 7T ^ 

ri'ri'K + 


Alt™ 
13.61-1 


+0.5 
+8.5 


3.5 
3.4 


3.1 
10.4 


2.1 
0.5 
2.0 


1511? 
6111 

11+7 + 1 (< 25) 



are AE, ities, the invariant masses of the two ?7,' ;7r7r , a 
Fisher discriminant T 0| , and the variable | cos Q p Acc \ . 
The Fisher discriminant T combines four variables: the 
angles, with respect to the beam axis, of the B momen- 
tum and the B thrust axis (in the T(AS) frame) , and the 
zeroth and second angular moments Lo,2 of the energy 
flow about the B thrust axis. The moments are defined 
by Lj = J2iPi x |cos 6*i | J , where 9i is the angle, with re- 
spect to the B thrust axis, of track or neutral cluster i, 
and pi is its momentum. The sum excludes the B candi- 
date daughters. 

The average number of candidates found per selected 
event is in the range 1.5 to 1.8, depending on the final 
state. We choose the candidate with the highest B vertex 
X 2 probability. From simulated events we find that this 
algorithm selects the correct candidate in about 82% of 
the events containing multiple candidates, and introduces 
negligible bias. 

We use Monte Carlo (MC) simulation to estimate back- 
grounds from other B decays, including final states with 
and without charm. These contributions are negligible 
for the rf^Tt modes. For rj' p ^ we include a BB component 
in the fit. We consider four categories in the likelihood 
fit: signal, self-cross feed (SCF) signal, defined as a sig- 
nal candidate where one B candidate daughter has been 
exchanged with a particle from the rest of the event, and 
continuum and BB backgrounds. 

For each event i and category j, the likelihood function 



A' 



(1) 



where N is the number of candidates, rij is the number 
of events in category j, and "Pj(Xj) is the corresponding 
probability density function (PDF), evaluated with the 
observables Xj of the ith event. Since correlations among 
the observables are small, we take each V as the product 
of the PDFs for the separate variables. We determine 
the PDF parameters from Monte Carlo simulation ^3] of 
the signal, SCF, and BB background, while using toes 
and AE sideband data (5.25 < m ES < 5.27 GeV/c 2 , 



0.1 < \ AE\ < 0.2 GeV) to model the PDFs of continuum 
background. 

We parameterize each of the functions T-^toes), 
V(AE), V(mri>), and V{m v ) for signal and SCF with 
two Gaussian distributions. The toes distribution for 
BB and continuum background is described by a thresh- 
old function 0]. The AE distribution for BB and con- 
tinuum background and the | cos 9^ cc \ distributions are 
represented by linear or quadratic functions. The distri- 
butions of m^i and m n in BB and continuum background 
are described by a Gaussian plus linear function. The dis- 
tribution of T is described with an asymmetric Gaussian 
function with a different width below and above the peak. 
We allow the continuum background PDF parameters to 
vary in the fit. Large control samples of B — * D(Ktttt)tt 
decays are used to verify the simulated AE and toes res- 
olution. 

In Table[l]we show the fitted signal yield, the fit bias in 
events, the detection efficiency, the product of daughter 
branching fractions for each decay mode, the significance 
>S (c), and the measured branching fraction. We compute 
the branching fractions from the fitted signal event yields, 
detection efficiencies, daughter branching fractions, and 
number of produced B mesons, assuming equal produc- 
tion rates of charged and neutral B meson pairs. We 
correct the yield for a fit bias estimated with the sim- 
ulations. We combine results from different sub-decay 
modes by adding the values of — 21nL , taking proper 
account of the correlated and uncorrelated systematic 
uncertainties. We report the statistical significance and 
branching fraction for the individual decay channels. For 
the combined measurements we also report the 90% con- 
fidence level (CL) upper limit. The statistical error on 
the signal yield is the change in the central value when 
the quantity — 21nL increases by one unit from its min- 
imum value. The significance is the square root of the 
difference between the value of — 21nL (with systematic 
uncertainties included) for zero signal and the value at 
its minimum. The 90% CL upper limit is taken to be 
the branching fraction below which lies 90% of the to- 
tal likelihood integral in the positive branching fraction 
region. 
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Figure ^ shows projections of charged and neutral 
T]'r]'K candidates onto tties and AE for the subset of can- 
didates for which the signal likelihood (computed without 
the variable plotted) exceeds a mode-dependent thresh- 
old that optimizes the sensitivity. 




5°25 5.26 5.27 5.28 5.29 
m ES (GeV/c 2 ) 
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FIG. 1: Fhe B candidate tties and AE projections for 
(a, b) and rj'rj' K% (c, d) for the combined sub-decay modes. 
Points with errors represent the data, solid curves the full fit 
functions and dashed curves the background functions. These 
plots are made with a requirement on the likelihood and thus 
do not show all events in the data samples. 
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(a) 



0.2 0.4 0.6 0.8 
L(Sg)/[L(Sg)+L(Bg)] 




0.2 0.4 0.6 0.8 
L(Sg)/[L(Sg)+L(Bg)] 




0.2 0.4 0.6 0.8 
L(Sg)/[L(Sg)+L(Bg)] 
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FIG. 2: The likelihood ratio L(Sg)/[L(Sg)+ L(Bg)] for the 
sub-decay modes of rj'rj'K: (a) r]' vnn r]' pi K + , (b) rf^rf^K^ , 
(c) VvTrirVpi K° , (d) r]' r)7T7T r] l r)7T7T K s . The on-resonance data are 
shown as points with error bars; the sum of all simulated 
background samples is shown by the shaded (dashed-line) his- 
tograms; and the sum of these backgrounds plus the signal 
from the PDF model are given by the open (solid-line) his- 
tograms. 



The goodness-of-fit is further demonstrated by the dis- 
tribution of the likelihood ratio between the likelihood 
L(Sg) for the signal category and the sum of the likeli- 
hoods for signal and all background categories L(Bg) for 
data and for simulation generated from the PDF model, 
shown in Figure [3 We see good agreement between the 
model and the data. The background is concentrated 
near zero, while any signal would appear in a peak near 
one. 

The main sources of systematic errors include uncer- 
tainties in the PDF parameters and the maximum like- 
lihood fit bias. For the signal, the uncertainties in the 
PDF parameters are estimated by comparing MC and 
data in control samples. Varying the signal PDF param- 
eters within these uncertainties, we estimate yield uncer- 
tainties up to 1 event, depending on the mode. The un- 
certainty from the fit bias is taken as half the correction 
itself (up to 4 events). Uncertainties in our knowledge 
of the efficiency, found from auxiliary studies, include 
0.8% x N t and 1.5% x 7V 7 , where N t and 7V 7 are the 
numbers of tracks and photons, respectively, in the B 
candidate. A systematic uncertainty of 1.8% is assigned 
to single photon reconstruction efficiency. There is a sys- 
tematic error of 2.1% in the efficiency of K® reconstruc- 
tion and 3.0% per 77 in the efficiency of 77 reconstruction. 
The uncertainty in the total number of BB pairs in the 
data sample is 1.1%. Published data provide the un- 
certainties in the B daughter product branching fractions 
(3.5-4.9%). 

In conclusion, we have measured 90% CL upper limits 
for the branching fractions: B(B° — > rj'rj'K ) < 31 x 10~ 6 



and/3(£? + — > ri'r] / K + ) < 25xl0~ 6 . From these results we 
conclude that no CP study is feasible in these B decays 
with the currently available data samples. 

We are grateful for the excellent luminosity and ma- 
chine conditions provided by our PEP-II colleagues, and 
for the substantial dedicated effort from the computing 
organizations that support BABAR. The collaborating 
institutions wish to thank SLAC for its support and 
kind hospitality. This work is supported by DOE and 
NSF (USA), NSERC (Canada), IHEP (China), CEA and 
CNRS-IN2P3 (France), BMBF and DFG (Germany), 
INFN (Italy), FOM (The Netherlands), NFR (Norway), 
MIST (Russia), and PPARC (United Kingdom). Indi- 
viduals have received support from CONACyT (Mex- 
ico), Marie Curie EIF (European Union), the A. P. Sloan 
Foundation, the Research Corporation, and the Alexan- 
der von Humboldt Foundation. 



* Also at Laboratoire de Physique Corpusculaire, 
Clermont-Ferrand, France 

t Also with Universita di Perugia, Dipartimento di Fisica, 
Perugia, Italy 

* Also with Universita della Basilicata, Potenza, Italy 

[1] BABAR Collaboration, B. Aubert et al, Phys. Rev. Lett. 
87, 091801 (2001); BABAR Collaboration, B. Aubert et 
al, Phys. Rev. Lett. 89, 201802 (2002); Belle Collabora- 
tion, K. Abe et al., Phys. Rev. Lett. 93, 191802 (2004); 
Belle Collaboration, K. Abe et al., Phys. Rev. D 66, 



7 



071102 (2002). 

[2] NA48 Collaboration, J. R. Batley et ai, Phys. Lett. 

B 544, 97 (2002); KTeV Collaboration, A. Alavi-Harati 

et a/., Phys. Rev. D 67, 012005 (2003). 
[3] BABAR Collaboration, B. Aubert et al, Phys. Rev. Lett. 

93, 131801 (2004); Belle Collaboration, K. Abe et al, 

Phys. Rev. Lett. 93, 191802 (2004). 
[4] N. Cabibbo, Phys. Rev. Lett. 10, 531 (1963); M. 

Kobayashi and T. Maskawa, Prog. Theor. Phys. 49, 652 

(1973). 

[5] BABAR Collaboration, B. Aubert et ai, Phys. Rev. Lett. 

91, 161801 (2003). 
[6] T. Gershon and M. Hazumi, Phys. Lett. B 596, 163 

(2004). 

[7] Belle Collaboration, A. Garmash et al, Phys. Rev. D 69, 
012001 (2004); BABAR Collaboration, B. Aubert et ai, 
Phys. Rev. Lett. 95, 011801 (2005). 



[8] Charge-conjugate modes are implied throughout. 

[9] BABAR Collaboration, B. Aubert et al, Nucl. Instr. 

Methods Phys. Res., Sect. A 479, 1 (2002). 
[10] PEP-II Conceptual Design Report, SLAC-R-418 (1993). 
[11] R. A. Fisher, Annals of Eugenics 7, 179 (1936). 
[12] The BABAR detector Monte Carlo simulation is based 

on GEANT4: S. Agostinelli et al, Nucl. Instr. Methods 

Phys. Res., Sect. A 506, 250 (2003). 
[13] The threshold function is defined as 

xy/1 — x 2 exp [— £(1 — x 2 )] , with x = 2m E s/ v / * an d 

£ is a parameter that is determined by the fit: ARGUS 

Collaboration, H. Albrecht et al, Phys. Lett. B 241, 

278 (1990). 

[14] Particle Data Group, S. Eidelman et al, Phys. Lett. 
B 592, 1 (2004). 



